The Image torque operator for mid-Level Vision: Theory and Experiment

Title of dissertation: THE IMAGE TORQUE OPERATOR FOR MID-LEVEL VISION: THEORY AND EXPERIMENT Morimichi Nishigaki, Doctor of Philosophy, 2012 Dissertation directed by: Professor Yiannis Aloimonos Department of Computer Science A problem central to visual scene understanding and computer vision is to extract semantically meaningful parts of images. A visual scene consists of objects, and the objects and parts of objects are delineated from their surrounding by closed contours. In this thesis a new bottom-up visual operator, called the Torque operator, which captures the concept of closed contours is introduced. Its computation is inspired by the mechanical definition of torque or moment of force, and applied to image edges. It takes as input edges and computes over regions of different size a measure of how well the edges are aligned to form a closed, convex contour. The torque operator is by definition scale independent, and can be seen as an operator of mid-level vision that captures the organizational concept of ’closure’ and grouping mechanism of edges. In this thesis, fundamental properties of the torque measure are studied, and experiments are performed to demonstrate and verify that it can be made a useful tool for a variety of applications, including visual attention, segmentation, and boundary edge detection. THE IMAGE TORQUE OPERATOR FOR MID-LEVEL VISION: THEORY AND EXPERIMENT by Morimichi Nishigaki Dissertation submitted to the Faculty of the Graduate School of the University of Maryland, College Park in partial fulfillment of the requirements for the degree of Doctor of Philosophy 2012 Advisory Committee: Professor Yiannis Aloimonos, Chair/Advisor Dr. Cornelia Fermüller, Co-Advisor Professor David Jacobs Professor Amitabh Varshney Professor Timothy Horiuchi, Dean’s representative c © Copyright by Morimichi Nishigaki 2012